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FOR THE INVENTION ENTITLED: 



"METHOD AND APPARATUS FOR TRANSFER OF 
REAL TIME SIGNALS OVER PACKET NETWORK" 



The invention is described in the following statement:- 



Raid of the Invention. 



Field of the Invention. 



The invention is in t he field of telecommunications, specifically telecommunications on 
a packet-switched network It is of protocol algorithm, procedure, and embodying net- 
work apparatus, for timely transfer and time-faithful reconstruction of real time signals, 
carried over the network as digital data packets. It has application in local, metropolitan 
and wide area networking as well as internetworking on diverse networks. It also has 
application in computer, control, weapon, automation, robotics and related systems. 



Background of the Invention 



Transfer of signals as digital data packets is already an accepted practice in computer 
networks. An outstanding example computer network is the world-wide Internet over 
which diverse signals are transferred as digital data packets, including real time signals 
such as telephone voice. 

The transfer of real time signals over computer networks as they are at present, includ- 
ing the Internet, is not however satisfactory in more than one respect and for more than 
one reason. The transfer of data packets over a computer network is in connectionless 
mode, which means that packets ate routed independently of each other, with the conse- 
quence that different packets carrying pieces of the same signal can reach the destina- 
tion in a different sequence from the one that they left the source. Any transposition of 
signal segments seriously impairs the overall signal. There is no assurance that all pack- 
ets sent from a source will reach the destination. Deletion signal segments impair the 
overall ^S gnfl l no than fr ftncpncUfon of their sequence. Delays of packets. inrnHwnrft 
of transpositions of packets, and losses of packets depend on network loading and all 
become severe when the network is congested. The network does not have any arrange- 
ments or means to prevent congestion. 

The invention is of protocol at the packet level, of packet assembly and dispatch proce- 
dures at so ur ce terminal, of packet routing and forwarding proc edures i n network ele- 
ments, and of procedures for signal presentation at the destination terminal that will 
provide satisfactory, faithful and reliable transfer of real time signals over a packet net- 
work The protocol of our invention carries timing information that will* support the 
time-aware forwarding function in network routers as well as faithful presentation of 
signals at the receiver. It also will support synchronization at the receiver in the presen- 
tation of multiple media. 



A condition for timely transfer of packets over a network is that all packets carrying a 
particular real time signal take the same path over the network and that elements along 
the path be prepared to perform the timely forwarding service on those packets. This 
condition amounts to a requirement that tte transfer be over a particular connection and 
that the elements along it have reserved resources for forwarding its declared traffic. 
Establishing such connection-oriented transfer, complete with nece s sary link bandwidth 
and buffer resources, is in part of the known art and not of our invention. Thus, while the 
Internet generally has connectionless Internet Protocol datagrams, it does have a defined 
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resource reservation protocol (RS VP) that can fulfill the function of establishing con- 
nections with reserved bandwidth and processing resources 1 . 

In arriving at our invention we have recognized that, while reserved bandwidth is neces- 
sary for real time signal transfer, such reservation of bandwidth is not of itself in all 
cases sufficient, It is sufficient when the transfer is by small, fixed size, blocks of infor- 
mation at regular intervals, when the reservation of bandwidth amounts to a promise of 
forwarding all individual blocks of information each within a specified maximum time 
from its submission. But where the transfer is in large or variable length blocks of infor- 
mation at irregular intervals, the reservation of bandwidth can amount only to a promise 
of a *ntnnm!m aggregated number of bits that would be transferred over an extended 
averaging time, such averaging time being large compared to the intervals between 
information blocks. The bandwidth reservation is then not sufficient to assure timely 
transfer* Procedures* additionally to bandwidth reservation, arc then required in infor- 
mation forwarding elements of the network that will provide for die timely dispatch of 
the separate blocks of infonnadoiL 

It might be thought that timeliness of dispatch would be assured if the forwarding ele- 
ments were sufficiently fast, work conserving, and employed first-in-first-out service 
disciplines. However that is adequate only when the Information blocks are small and 
regular, and even then only when timeliness requirements are uniform across connec- 
tions. Given information blocks of different sizes and/or unequal timeliness require- 
ments among different connections through an element, the forwarding procedures need 
to take regard of individual requirements. It is even possible for the timeliness require- 
ments to vary from one block to the next on the same connection, and the forwarding 
procedure ought to take regard of that as well. 

Other disciplines besides first-in-first-out exist or are known 2 , some with individual ser- 
vice differentiation and able to satisfy different timeliness requirements, albeit in a very 
limited way. A discipline that comes closest to that of our invention is the delay-earliest- 
due-date discipline. In this, a contract is negotiated between user and server specifying 
the peak and average rate of blocks, and a bound on delay that a block would need to 
experience in the network element . The server sets a deadline for the disp atch of a block 
as it enters the network element such deadline being a fixed delay (the negotiated 
bound) beyond the theoretical time at which the packet would have entered, had it come 
in accordance, with contract. There is thus possibility of individually specified timeli- 
ness, but only on a connection not individual blocks. Moreover the bandwidth reserva- 
tion has to be based on the peak rate of blocks and the blocks must be of fixed size. 

Insights on the fundamental requirements for real time signal transfer that have led us to 
our invention are that the delay between the instant at which a particular value of the 
signal is generated at the source and the instant at which that value is presented at the 
destination must be a constant over an entire communication session, and the clock by 
which the signal is presented at the destination must be synchronized to the clock with 



1, R. Branden, L. Zhang, S. Berson. S, Herzog, "Resource Reservation Protocol (RS VP)", RFC 
2205, September 1997. 

2. Hui Zhang and Srinivasan Keshav "Comparison of Rate-Based Service Disciplines" Proceed- 
ings of ACM SIGCOMM'91 
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which the signal is generated at the source. A requirement related to the previous two 
and implying them, is that once presentation has commenced at the receiver, it remain 
continuous over the session: On the instant, or before, the last bit of the first block of 
information has been consumed in generating the presentation, the next block of infor- 
mation completes its arrival at the destination, and similarly for the second, third, and all 

subsequent blocks. 

Further insights needed towards our invention are on the nature of represen t a ti on c£ real 
time signals by digital data at varying rate, and the regeneration of the signal from those 
data. Blocks of data can be identified that represent particular intervals of the signal. In 
representation at varying rate, the size of block is not directly related to the length of 
interval, and vice vera*. However the same length of time will elapse in the consumption 

of a block when generating the presentation at the receiver as took to a cc u m ulate that 
block at the source. Also, U is possible to represent an interval of signal by a block of 
data independently of the signal in other intervals or of the representation of those inter- 
vals in other blocks. We assume that such block by block indepe nd e n ce applies to the 
variable rate real time signal transfer for which our invention is used. 



Brief Description of the Invention 



Hie invention is of procedures at source, at intermediate network elements , and at the 
destination, as well as protocol information at packet level, originating at the source, 
and transmitted in the packet for support of the procedures at intermediate elements and 
the destination. 

We describe the invention in its application to the Internet, employing Internet Protocol 
(IP) \fersion 6 l , However the invention is not restricted to the Internet or to IPv6. With 
appropriate modifications to protocol format it can be applied to any packet-switched 
network or packet routing/switching system, whether extended ewer the wide area, con- 
fined to metropolitan or local areas* or even on smaller scale. Nor is it restricted to Ver- 
sion 6 of IP. It can be applied, with no or only obvious modification in procedures, to 
IPv4, the current version of the Internet Protocol. 

The Internet Protocol (EP) provides the functionality for interc onnecting end systems 
across multiple networks. To that end. IP is implemented in each end system and in 
routers, which correspond to the intermediate network elements of the foregoing general 
description. Higher level data ai the source end system are encapsulated in an IP proto- 
col data unit (PDU) for transmission, An IP PDU passes through one or more networks, 
and connecting routers to reach the destination end system. 

For the transfer of real time signals, IP packets with appropriate real time header exten- 
sion are utilized. Each IP packet in a flow represents a fragment of the real time signal 
All fragments in the flow are transferred over the same Internet connection. On receiv- 
ing a real time packet fragment, an IP router must forward it on time, or sooner. The 



1. William Stallings "IPv6: The New Internet Protocol". IEEE Communications Magazine, July 
1996, pp 96-108 
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time by which a fragment must be forwarded, Is determined by the local state of the 
connection that carries the fragment. Each connecting router has to be time-aware with 
respect to all connections that are set up over it. Time-awareness of a router is possible 
only if the router has a clock, the clocks of routers and of sources and destinations aie 
synchronous, or at least pleisochronous with each other and the router is provided with 
appropriate time information by sources* 

The time information is carried by packet headers. We assume definition of real time 
extensions to IP headers, framework for such extensions already exists* Thus in IPv6 1 , 
it will become an instance of a hop-by-hop options header. The extension would mini- 
mally have the following three fields: 

1. 2 -bit field. ORDER, indicating Beginning Of a Stream (BOS), Continuation 
Of a Stream (COS), End Of a Stream (EOS), Single Fragment Stream (SFS); 

2. TV-bit unsigned integer field, TIME, to indicate the time instant at the 
source At which the first sample of the real time signal represented by the frag- 
ment; 

3 M -bit unsigned integer field, DELTAJITME, to indicate the time interval AT 
of the real time signal that is covered by the payload of the fragment 

The size of N and M depends on the unit of time and the range of values that need to be 
represented, A suitable unit for Ume, for the purposes of our Invention* is a nano-second 
( 10" seconds). 

A connection i , identified by source and destination IP addresses and UDP Port num- 
bers or by flow label sends fragments Fy . ; = 0, 1,2 The length of each frag- 
ment is denoted by Lij . The timing parameter values carried by each fragment arc AT U 
and time units. 

On receipt of the first fragment F, 0 , a router r waits for WATT, , time units before dis- 
patching the fragment. WATT r ; is a parameter that is fixed at connection set-up. The 
router r then notes the time t at which dispatch of F i0 was complete, calculates the 
deadline for the completion of dispatch of fragment F i x as DL n = / + A7\ 0 and 

On receipt of the successive fragments F i}% ( j > 0) . the router r checks for a loss frag- 
ment via predicate T it ^ 2> ^ _ If the predicate returns fake indicating a loss of a 
fragment, the router r treats the fragment Fy as F iQ , Otherwise, it schedules the start 
ofdkpatchatT^^ - DL, ; - L t /R l where R t h the rate of the link on which F tJ is 
to be sent The router r dispatches F u as soon as possible, not waiting fa y , but 
observes 'earliest start - next to go' rule. The router r also calculates the deadline for 
the completion of dispatch of the next fragment as DL /(y + n = DL-, + AT U and records 

On receipt of the first fragment F i0 . the receiver notes the time ( s and starts the presen- 
tation without delay. On finish of the presentation of F i0 . the receiver notes the time i f 



1. William S tailings "IPv6: The New Internet Protocol", IEEE Communications Magazine, July 
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and calculates At = t f -t t .1f &t> AT iQ then the application clock rate is appropri- 
ately increased. On the other hand, if At < AT i0 then the application clock rate is appro- 
priately decreased. 

On receipt of the successive fragments F f7 . (y > 0) , the receiver checks to see whether 
the presentation buffer is empty or noL If the buffer is empty, it restarts the presentation 
following an interrupt Otherwise, the receiver waits for the presentation of previous 
fragments to be completed and continues the presentation without an interrupt At the 
start of the presentation of F i} , the receiver notes the time t s . On finish of the presenta- 
tion of F i} , the receiver notes the time t f and calculates At = t f -t Mt J£At>AT ij 
then the application dock rate is appropriately increased On the other hand, if 

At<AT iJ then the application clock rate is appropriately decreased. 

With proper design and Call Admission Control (CA.Q, interruptions in presentation at 
die receiver can be expected to be rare. It can be expected that all routers, including the 
immediately upstream router, will have completed the dispatch of a fragment Fjj by 
their respective deadline DL y . The parameter WAIT rw must be chosen so that* with 
given CAC, it would be sufficient to ensure a low probability of missing the deadline. 
WAIT,,,- must not be larger than necessary as it is a component in the end-to-end delay. 

Assuming no interrupts to the presentation at the receiver, fixed end-to-end delay is 
given by the sum of three deterministic components, namely the packetization delay 
ATn of the first fragment, sum of W ATT r , over all routers that the connection / 
traverses and the end-to-end propagation delay. For low rate applications, the packetiza- 
tion delay will dominate whereas, for high rate applications, the sum of WAIT,, ; will 
dominate. 

Our invention not only provides a constant end-to-end delay of signal which is a princi- 
pal consideration in real time communications but also allows the transfer of applica- 
tions clock and synchronization of multiple media. 
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